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ABSTRACT 

For  a  solvable  monotone  complementarity  problem  ne  show  that  each 
feasible  point  which  is  not  a  solution  of  the  problem  provides  simple 
numerical  bounds  for  some  or  all  components  of  all  solution  vectors. 
Consequently  for  a  solvable  differentiable  convex  program  each  primal -dual 
feasible  point  which  is  not  optimal  provides  simple  numerical  bounds  for 

'fo  l  '  '  ' 

some  or  all  components  of  all  primal-dual  solution  vectors.  *le  also  give  an 
existence  result  and  simple  bounds  for  solutions  of  monotone  complementarity 
problems  satisfying  a  new,  distributed  constraint  qualification.  This 
result  carries  over  to  a  simple  existence  and  boundedness  result  for  dif¬ 
ferentiable  convex  programs  satisfying  a  similar  constraint  qualification. 
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SIGNIFICANCE  AND  EXPLANATION 


Simple  bounds  are  given  for  solutions  of  fundamental  optimization 
problems:  monotone  complementarity  problems  and  convex  programs.  It  is 
shown  that  each  nonoptimal  but  feasible  point  carries  within  it  simple 
numerical  information  which  bounds  some  or  all  components  of  all  solu¬ 
tion  vectors.  Thus  bounds  are  obtained  without  solving  the  problems. 


The  responsibility  for  the  wording  and  views  expressed  in  this  descriptive 
summary  lies  with  MRC,  and  not  with  the  authors  of  this  report. 


SIMPLE  BOUNDS  FOR  SOLUTIONS  OF  MONOTONE 
COMPLEMENTARITY  PROBLEMS  AND  CONVEX  PROGRAMS 


0.  L.  Mangasarian,  L.  McLinden 

1 .  The  Monotone  Complementarity  Problem 

This  work  is  based  on  an  extremely  simple,  but  apparently  unnoticed, 

property  of  the  monotone  complementarity  problem  [2,5,8,11,12]  of  finding 

2k 

a  (z,w)  in  the  2k-dimensional  Euclidean  space  R  such  that 

(1.1)  w  =  F(z)  >_  0,  z  >_  0,  zw  *  0 

k  k  k  • 

Here  F:  D  ■+•  R  is  a  monotone  function  on  D  where  R+  c  D  c  R  ,  that  is 

(22-2])(F(22)  -  Ffz1))  >  o  for  all  z1 ,  z2  e  D 

The  property  is  the  following: 

1.1  Theorem  Let  (z,w)  be  some  feasible  point  of  a  solvable  monotone 
complementarity  problem  (1.1),  that  is  w  3  F(z)  >  0,  z  >  0.  Any  solution 
(z,w)  of  (1.1)  is  bounded  as  follows: 

(a)  pjH, :3  ^  21  <  zw/min  zw/ min  wi 

(b)  ||wj || i  <  zw/min  z.eJ 

(c)  ||zr  wj ||1  <  zw/min  (zieJ,  w.^} 
where  I  3  (f |w^  >  0}  and  J  3  (i |z.  >  0}. 
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Proof  For  any  solution  (z,w)  of  (1.1)  we  have  by  the  monotonicity  of 
F  and  zw  =  0  that 


zw  £  zw  +  zw 

Hence  by  the  nonnegativity  of  (z,w)  and  (z,w)  we  have 

(a)  zw  >  ijWj  >  ]| || i  min  wigI 

(b)  ^  >  ZjWj  >  HSjll,  «1n  zieJ 

(c)  zw  >  ijWj  +  ZjWj  >  llij.wjl^  •  min  {zieJ,wigI}  □ 

Theorem  1.1  is  a  partial  extension  to  the  monotone  complementarity 
problem  of  a  corresponding  result.  Theorem  2.2  of  [7],  for  the  positive 
semidefinite  linear  complementarity  problem.  Note  that,  unlike  the  linear 
case,  feasibility  for  the  nonlinear  monotone  complementarity  problem  does 
not  imply  solvability  as  shown  by  the  simple  example  of  [10], 

Theorem  1.1  shows  that  any  feasible  point  (z,w)  of  a  solvable 
monotone  complementarity  problem  (1.1)  which  is  not  a  solution  of  the 
problem  (so  that  at  least  I  is  nonempty  or  J  is  nonempty)  provides 
some  information  about  the  magnitude  of  the  solution  set.  In  certain 
cases,  such  as  when  w  >  0,  we  get  a  bound  on  all  components  of  all 
solution  vectors  z. 

With  the  bounds  given  by  Theorem  1.1  it  is  possible  to  obtain  bounds 
for  optimal  solutions  and  multipliers  of  solvable  differentiable  convex 
programs  once  they  are  cast  as  monotone  complementarity  problems.  (See 
Section  2.)  But  before  doing  that  we  show  how  the  bounds  of  Theorem  1.1 
can  be  extended  to  approximate  solutions  of  monotone  complementarity 
problems  which  may  not  even  be  solvable.  Let 


and  for  e  >  0  let  (z(e),  w(e))  be  an  e-solution  of  the  optimization 
problem  of  (1.2),  that  is 

(1 .3)  w(e)  *  F(z(e))  >  0,  z(e)  >  0,  a  +  e  >_  z(e)w(e)  >  a 

Note  that  for  any  e  >  0,  an  e-solution  always  exists  provided  problem 
(1.2)  has  at  least  one  feasible  point.  A  0-solution  exists  provided  the 
infimum  of  (1.2)  is  attained,  that  is  the  infimum  Is  a  minimum.  Furthermore 
if  a  a  0,  then  an  e-solution  of  (1.2)  is  an  "approximate"  solution  of  the 
complementarity  problem  (1.1)  which  is  an  exact  solution  If  e  3  0.  With 
these  concepts  In  mind  it  follows  from  (1.2),  (1.3)  and  the  monotonicity  of 
F  that,  for  any  feasible  (z,w)  and  e  >  0, 

(1.4)  2zw  +  e>zw+a  +  e>zw  +  z(e)w(e)  >  zw(e)  +  z(e)w 

Consequently,  arguing  exactly  as  in  Theorem  1.1  we  obtain  the  following 
bounds  for  e-solutions  of  the  optimization  problem  (1.2). 

1.2  Theorem  Let  F  be  monotone  on  R*  and  let  (z,w)  be  some  feasible 
point  of  the  optimization  problem  of  (1 .2),  that  is,  w  *  F(z)  >0,  z  >  0, 
and  let  e  >  0.  Any  e-solution  (z(e),  w(e))  of  (1.2),  defined  by  (1.3), 
is  bounded  as  follows: 

(a)  || (e ) || i  <  (zw  +  a  +  e)/m1n  w^cI  <  (2zw  +  e)/m1n  wicI 

(b)  ||wJ(e)||1  <  (zw  +  o  +  ej/min  zl£j  <,  (2zw  +  e)/min  z1eJ 

(c)  HzjU),  WjUJHj  <  (zw  +a  +  e)/m1n  {z1ej**1€l}  ^^2zw  +  e)/min  {Z1eJ*W1eI} 

where  I  ■  {1|w4>0}  and  J  ■  (1|z,  >0). 
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Note  that  this  theorem  subsumes  Theorem  1.1.  For  If  we  assume  that  the 
complementarity  problem  (1.1)  is  solvable  as  in  Theorem  1.1,  then  we  can  set 
a  ■  e  *  0  in  Theorem  1.2  and  obtain  Theorem  1.1. 

A  generalization  of  Theorem  1.2  is  possible  if,  instead  of  one  feasible 
point  (z,w),  we  consider  p  feasible  points  (z^,wJ),  j«l,2,...,p,  of 

the  optimization  problem  of  (1.2)  and  correspomding  weights  X^  >  0,  j»l,...,p, 
P  , 

such  that  7  XJ  =  1 .  Then  by  (1.2),  (1.3)  and  the  monotonicity  of  F  we  have 
j-1 


p...  p  ..  p...  p.  p 

(1.5)  2  l  X^zJw^+e>  7  X^z^wJ+a  +  e>  7  XJzJwJ  + z(e)w(e)  >  7  XJz^w(e)  +  7  X^z(e)w^ 

j-1  “j-1  "j-1  "j-1  j-1 

Again  arguing  as  in  Theorem  1.1  we  obtain  the  following  bounds. 

1.3  Theorem  Let  F  be  monotone  on  R*  and  let  (z^.w^),  j*l,2,...,p,  be 
feasible  points  of  the  optimization  problem  of  (1.2),  that  is,  w^  -  F(z^)  >,  0, 

zj  >  0,  j-l,2,...,p.  Let  XJ  >  0,  j-1 ,2, . . . ,p,  £  X^  -  1  and  let  t  >  0.  Any 

j-1 

e-solution  (z(e),  w(e))  of  (1.2)  defined  by  (1.3)  is  bounded  as  follows: 


p 

Y  JJuX 


P  .  .  . 


(a)  ||zj(e)  || ^  <,  (  ^XJzJwJ+a+e)/min  wieI  <,  (2^ XJzJwJ+e) /min  w^j 

p  p 

(b)  ||w,(e) II-.  <(  l  X^zJw^+a+e)/min  z.  ,  <(2£  X^z^+e)/min  z.  , 

j-1  j-1 

P  p 

(c)  ||Zj(e),  Wj(c) ||  1  <  (  l  X^z^w^+a+e)/min{z.£j,wieI}  <  (2  y  XJzJw^+e)/min{z1eJ,w.eI] 

j— 1  j— 1 

P  <  4  P  {  < 

where  I  =  { i  j w .  >  0} ,  J  -  (i|z.  >0),  z:*  £  X^z^  and  w:=  7  X^w  . 

j-1  j-l 

We  note  that  the  first  inequality  of  each  of  (a),  (b)  and  (c)  of  Theo¬ 
rem  1.3  remains  valid  even  If  we  do  not  require  that  wJ  >_  0  and  z^  >  0,  but 
merely  that  z ^  e  0,  where  c  0  c  R^,  F  Is  monotone  on  D  and  z  £  0 
and  w  >  0.  This  remark  will  be  employed  in  Theorem  1.4. 


An  application  of  Theorem  1.3  is  the  following  boundedness  result 
for  complementarity  problems  satisfying  a  new,  "distributed"  constraint 
qualification,  and  for  which  we  also  establish  an  existence  result. 

1.4  Theorem  (Existence  and  boundedness  of  solutions  of  monotone  complemen¬ 
tarity  problems  under  a  distributed  constraint  qualification)  Let 

k  k  k 

F:  D  R  be  monotone  and  continuous  on  D  such  that  R+  <=  D  c  R  ,  let 

Z^eD,  w^  *  F(z^}eRk,  j=l  ,2,...,p,  be  such  that  Z:=*  f  XJzJ  >  0, 

e  .  ,  .  p^' 

w:*  l  XJwJ  >  0  for  some  AJ  >  0,  j=l,2,...p,  £  X .  »  1 .  Then  the  complemen- 
j*l  "  j=l  J 

tarity  problem  (1.1)  is  solvable.  Any  solution  (z,w)  is  bounded  as  follows: 

(1.6)  p|L  <  (  l  XjzV)  /  min  w. 

1  j»l  l<i<k  1 

Proof  The  bound  (1.6)  follows  from  Theorem  1.3(a)  with  a  =  e  *  0  and  the 
remark  following  it,  once  we  have  established  the  existence  of  a  solution  to 
the  complementarity  problem  (1.1),  which  we  proceed  to  do  now  by  means  of  the 
Brouwer  fixed  point  theorem  [1,14].  Let 

C:=  (zjz^O,  wz  <  wz  +  Y) , 


where 

p  i  i  i 

(1 .7)  y  >  max  (1 ,  -  wz  +  j  AJzJwJ)  >  1 

j»l 

The  set  C  is  nonempty,  compact  and  convex  and  the  single-valued  mapping  [4] 
defined  by  the  2-norm  projection  of  z  -  F(z)  on  C  : 

z  -*■  argmin  ||y  -  z  +  F(z)|L 
y«c  2 


defines  a  continuous  function  from  C  into  Itself.  Hence  by  Brouwer's 
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theorem  this  function  must  have  a  fixed  point  zeC.  Such  a  point  satisfies 
the  minimum  principle  optimality  condition  [6]. 

(1.8)  ZeC,  F(z)(y  -  z)  >  0  Vy  e  C 

If  wz  <  w2  +  y  then  z  solves  (1.1).  Indeed  z  +  6e^,  1=1 , 2,..., k,  is 
in  C  for  6  sufficiently  small  and  positive  and  ei  the  ith  unit  coordi¬ 
nate  vector,  and  hence  by  (1.8)  it  follows  that  F(z)  0,  z  ^  0,  and 
zF(z)  <  0  by  taking  y  =  0  in  (1.8).  We  now  show  that  the  case 

(1.9)  wz  =  w2  +  y 

cannot  occur.  For  if  it  did,  then  from  the  monotonicity  of  F  we  have 

zF(z)  >  -Z'M  +  zJw  +  zw^,  j*l,2,...,p 

where  w:  =  F(z).  Multiplying  by  \ ^  and  summing  over  j  gives 

P  , 

zF(z)  >  l  -  XJzV  +  zw  +  zw 
"j-1 

>  zw  ■  zF(z)  (By  (1.9)  and  (1.7)) 

Hence  F(z)(z-z)  <  0  which  contradicts  (1.8).  So  (1.9)  cannot  occur  and 
z  solves  (1.1).  □ 

We  note  that  the  existence  part  of  the  above  theorem  for  the  ordinary 
constraint  qualification,  that  Is  p  *  1,  was  obtained  by  Mor£ 

[12,  Theorem  3.2]  and  by  one  of  the  authors  In  [8,  Theorem  1]  for  the  case 
of  multivalued  monotone  mappings. 

It  is  interesting  to  note  that  the  complementarity  problem  of  Megiddo 
[10]  which  has  no  solution  does  not  satisfy  the  distributed  constraint 
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qual ification  of  Theorem  1.4  and  hence  demonstrates  the  sharpness  of  that 
condition.  On  the  other  hand  Theorem  1.3(a)  can  be  used  to  give  an  exact 
upper  bound  on  the  bounded  component  of  the  solution  of  problem  (1.2)  for 
Megiddo's  example. 

We  also  note  the  distributed  constraint  qualification  of 

Theorem  1.4  is  implied  by  the  ordinary  constraint  qualification  if 

k  k 

we  take  p  *  1 .  The  converse  is  true  if  D  *  R+  and  F  is  concave  on  R+. 

However  F  is  not  concave  in  general,  and  in  fact  is  merely  monotone  when 

it  is  derived  from  a  differentiable  convex  program.  (See  Section  2.)  How- 

1/ 

ever  for  the  general  case  of  a  monotone  F  and  D  *  R*,  it  can  be  shown 
[9]  that  the  two  constraint  qualifications  are  equivalent.  Nevertheless 
the  distributed  qualification  may  be  easier  to  verify. 
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2.  Bounds  for  Solutions  of  Convex  Programs 

We  consider  now  the  solvable  differentiable  convex  program 


(2.1)  min  f(x)  s.t.  y  *  -g(x)  >0,  x  >  0 

x 

where  f:  Rn  ■+•  R,  g:  Rn  -*■  Rm  are  convex  and  differentiable  functions, 
together  with  its  dual  [6] 

(2.2)  max  L(x,u)  -  xVxL(x,u)  s.t.  v  =  VxL(x,u)  >0,  u  >_  r 
x,u 

where  L(x,u)  is  the  standard  Lagrangian 

L(x,u)  =  f ( x )  +  ug(x) 

and  Vx  denotes  the  gradient  vector  with  respect  to  x.  We  note  that  the 
Karush-Kuhn-Tucker  conditions 


v  *  Vxl(x,u)  *  7f(x)  +  uVg(x)  0,  x  >  0,  xv  *  0 


(2.3) 

y  *  -VyL(x,u )  =  -g(x)  >  0,  u  _>  0,  uy  =  0 

hold  if  and  only  if  (x,y,u,v)  solves  the  dual  programs  (2.1)-(2.2)  with 
equal  extrema  [6],  If  the  constraints  of  (2.1)  satisfy  the  Slater  constraint 
qualification,  that  is  g (x )  <  0  for  some  x  _>  0,  then  for  each  solution  of 
(2,1)  the  Karush-Kuhn-Tucker  conditions  (2.3)  are  satisfiable  [6],  If  we 
make  the  definitions 


(2.4) 


then  the  Karush-Kuhn-Tucker  conditions  take  on  the  equivalent  complementarity 
problem  formulation  [2] 
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(2.5)  w  =  F(z)  >  0,  Z  >  0,  zw  »  0 

Note  that  the  "twisted"  derivative  involved  in  the  definition  of  F(z)  has 
also  been  used  in  [3,13,5,8].  We  now  establish  the  monotonicity  of  this  F(z). 

2.1  Lemma  Let  f  and  g  be  differentiable  and  convex  on  Rn  and  let  F(z) 
be  defined  as  in  (2.4).  Then  F (z )  is  monotone  and  continuous  for  all 
ze  Rn  xr™. 

Proof  By  the  convexity  of  g  and  il  >  0,  u  >  0  we  have  that 

u  (g(x)  -  g(x))  >  uVg(x)(x  -  x) 

-u(-g(x)  +  g (x ) )  >,  -uVg(x)(-x  +  x) 

Addition  of  these  two  inequalities  gives 

(2.6)  -  (u-u)(g(x)-g(x))>  (uVg  (x )  -  uVg(x))  (x  -  x) 

Hence 

(z-i)(F(z)-F(z))  -  (x-x  u-u)  /7xL(x,u)-7xL(x,u)\ 

V  -  (g(x)  -  g(x))  / 

>,  (x-x)(Vf (x)-Vf (x))  (By  (2.6)) 

>_  0  (By  convexity  of  f) 

The  continuity  of  F  follows  from  the  fact  that  a  differentiable  convex 
function  on  Rn  is  continuously  differentiable.  0 

We  can  now  apply  Theorem  1.1  to  the  monotone  function  F(z)  of  (2.4) 
to  obtain  bounds  for  optimal  solutions  and  multipliers  of  (2.1). 

2.2  Theorem  Let  f  and  g  be  differentiable  and  convex  on  Rn.  Each 
primal-dual  feasible  point  of  (2.1)-(2.2),  that  is  (x,y,u,v)  satisfying 
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y  3  -g(x)  >  o,  x  >  0,  v  *  VxL(x,u)  >0,  u  >  0, 

bounds  any  point  (x,y,u,v)  which  solves  the  primal-dual  programs  (2.1 )-(2.2) 
with  equal  extrema,  or  equivalently,  which  satisfies  the  Karush-Kuhn-Tucker 
conditions  (2.3)  for  (2.1)  as  follows: 

(a)  I  x,  *:  ||x.  )|.  <  (xv  +  uy)/m1n  vf  T 

i  e  1 1  1  *1  '  '  1cil 

(b)  l|yj2II1  <  (XV  +  uy)/min  uicJ^ 

(c)  -  (xv  +  uy)/min  yieI 

(d)  Hvj  II,  <  (xv  +  uy)/min  xieJ^ 
where 

I-|  3  0  |vi  >  0},  J2  =  { 1 1 u1-  >  0},  I2  =  {i  |yi  >  0},  ^  =  {1 J x .  >  0} 

Proof  Immediate  from  Theorem  1.1,  Lemma  2.1  and  definition  (2.4).  □ 

Theorem  2.2  is  a  partial  extension  of  Theorem  3.1  of  [7]  where  bounds 
for  solutions  of  linear  programs  were  given. 

All  the  other  theorems  of  Sectiom  1  apply  in  a  straightforward  manner 
to  the  convex  program  (2.1)  via  the  complementarity  formulation  (2.4)-(2.5). 
We  state  below  the  counterpart  of  Theorem  1.4  for  the  convex  program  (2.1). 

2.3  Theorem  (Existence  and  boundedness  of  solutions  of  differ¬ 
entiable  convex  programs  under  a  distributed  constraint  qualification) 

Let  f  and  g  be  differentiable  and  convex  on  Rn,  let 

yj  3  -g(xj)  e  Rm,  xj  e  Rn,  vj  -  VxL(x^,  uj)  e  Rn,  uj  >  0,  j»l  ,2 . . 
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be  such  that  for  some  \3  >  0,  j-1,2 . p,  ?  X.  *  1: 

3 

*:*£  xJxJ  >  0.  Xjyj  >  0,  v:«  f  xV  >  0 

j-1  j*l 

Then  there  exists  (x,y,u,v)  which  solves  the  dual  programs  (2.1 )-(2.2)  with 
equal  extrema.  Any  such  solution  (x,y,u,v)  Is  bounded  as  follows: 

llx.ull,  <  (  l  Xj(xJvJ  +  u^yJ ) )  /  min  {v.,y.} 
j=1  1<i<n 

lT#,<m 

Note  that  the  requirement  u^  >,  ®  1°  Theorem  2.3  is  made  because  the  mono 
tonicity  of  F  of  Lemma  2.1  is  established  only  on  Rn  *  r'J  and  not  on  Rn*Rm. 
We  give  now  a  simple  example  illustrating  the  bounds  of  Theorem  2.2. 

x, 

2.4  Example  min  x^  +  x2  s.t.  y  *  x2  -  e  £  0,  x^ ,  x?  ^  0 
The  dual  problem  is 

x-, 

max  x-j  +  Xj  -  u(x2-e  )  -  vx 
*1 

s.t.  v-|  =  1  +  ue  >  0 

v2  3  1  -  u  >0 

u  >_  0 

The  primal -dual  solution  is  x-j  =  0,  x2  *  1 ,  y  =  0,  u  a  1 ,  v1  *  2,  v2  *  0. 

(a)  To  get  a  bound  on  ||x||lf  take  x-j  =  a  >  0,  x2  *  ea  and  u  *  0.  Hence 

y  =  0,  v-j  *  1 ,  v2  =  1 ,  xv  +  uy  *  a  +  ea  and 

1  *  11*11-,  <  inf  a  +  ea  *  1 
'  "  ct>0 

(b)  To  get  a  bound  on  ||y||-,,  take  x-j  *  a  >  0,  x2  «  ea  and  u  »  1.  Hence 

y  ■  0,  v1  »  1  +  ea,  v2  *  0,  xv  +  uy  ■  a(l  +ea)  and 
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0  3  ||y ||,  <  inf  a(l  +ea)  *  0 
1  “  a>0 

(c)  To  get  a  bound  on  ]| u || -j ,  take  *  1  >  0,  »  a  +  e,  a  >  0  and 

u  *  1.  Hence  y  =  a,  *  1  +  e,  Vg  s  0,  xv  +  uy  a  1  +  e  +  a  and 

1  *  ||ul|  <  inf  =  1 

1  a>0  a 

(d)  To  get  a  bound  on  ]| v |] ^ ,  take  x^  *  a  >  0,  x^  *  ea  and  u  *  1. 

Hence  y  *  0,  =1  +  ea,  =  0,  xv  +  uy  =  a(l  +  ea),  and 

2  •  ||*|l,  <  Inf  -  2 

Me  conclude  by  remarking  that  extensions  of  the  results  in  this  paper 
can  also  be  established  for  the  more  general  case  in  which  the  continuous 
monotone  function  F  is  replaced  by  a  maximal  monotone  multifunction. 

Such  extensions  allow  us  to  handle  problem  (2.1)  with  f  and  g  nondiffer- 
entiable,  convex  and  possibly  taking  the  value  of  ■*».  Further  extensions 

t 

can  also  be  proved  in  which  R  is  replaced,  for  example,  by  any  reflexive 
Banach  space  and  R+  is  replaced  by  a  closed  convex  cone  satisfying  certain 
interiority/1 inearity  properties. 


t 
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